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COMMUNICATION APPARATUS, ITS CONTROL METHOD, 
AND STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a communication 
apparatus which receives and displays image data and 
the like sent from, e.g., a communication apparatus at 
a remote location connected through a communication 
network, a control method for the communication 
apparatus, and a storage medium. 
Related Background Art 

One video transmission system has been proposed. 
In this system, for example, plural video cameras and 
computers are located inside a building, and these 
video cameras and the computers are networked through 
communication lines, thereby realizing video 
transmission among plural desired points and 
interactive communication by video and audio. 

In such the video transmission system, a user of 
the computer at one point can remote-control the video 
camera at the desired point and display the video taken 
by the remote-controlled video camera on the screen of 
own computer. 

Further, in the video transmission system capable 
of remote-controlling the video camera, especially, as 
the number of the video cameras to be remote-controlled 
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increases, it is necessary for the user to easily 
understand where each video camera is located. Thus, 
the technique which superimposes a camera symbol 
representing the location of each video camera on an 
5 image representing a map has been proposed. Further, 
the technique which represents the direction of the 
actual video camera by displaying the direction of the 
camera symbol has been proposed. 

Further, a method of controlling the video camera 
10 by transferring a camera control parameter stored as 
preset ( control ) information to the video camera has 
been proposed. 

In the above system, the user can quickly and 
precisely control the video camera to a desired object 
15 by using the preset (control) information, and a 
necessary video can be obtained. 

However, in a conventional system, the preset 
(control) information is managed on a user interface as 
sequential number or a title of an object or scenery to 
20 be displayed (for example, "Reception" or "front of 
Elevator"). That is, there was a problem that 
relationship between each of two preset information 
(i.e., imaging direction change of a sequential number 
1 and a sequential number 2) had not been intuitively 
2 5 known . 

Further, the preset information is applied to the 
video camera by selecting the sequential number or the 
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"title on the user interface using a mouse or a 
keyboard. That is, when an operator wants to control 
the video camera mainly referring to the map, since 
cursor movement (shift) by the mouse was frequently 
5 required, a complex operation has been brought. 

SUMMARY OF THE INVENTION 

An object of the present invention is to solve the 
above problem and realize that an operator can easily 
10 grasp the state change of an imaging apparatus, to 

which stored control information is applied, on a map. 

Another object of the present invention is to 
provide a means for applying the stored control 
information to the imaging apparatus using the map and 
15 realize to operate the imaging apparatus mainly 
referring to the map. 

In order to solve the above problem, the present 
invention provides a communication apparatus which 
receives image data imaged (taken) by the imaging 
20 apparatus connected through a network, comprises a 

storage means (store preset information) for storing 
control information to control the imaging apparatus, 
an output means (display a camera icon) for outputting 
to a display unit a synthetic image which is obtained 
25 by synthesizing a symbol representing a state of the 
imaging apparatus to image information indicating a 
setting location of the imaging apparatus in accordance 
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with the control information stored in the storage 
means, and an output means (display a preset symbol) 
for outputting to the display unit a synthetic image 
which is obtained by synthesizing a symbol 
5 corresponding to the control information stored in the 
storage means to the image information. The 
communication apparatus further comprises a means 
(shift (move) a preset symbol) for determining a 
synthesizing position when the symbol corresponding to 

10 the control information is synthesized to the image 
information, and a control means (control a video 
camera by clicking a preset symbol) for controlling the 
control information to control the imaging apparatus is 
to be applied to the imaging apparatus by an operation 

15 to the symbol which corresponds to the control 
information . 

Still another object of the present invention is 
to provide a new function. 

Other features of the present invention will 
20 become apparent from the following embodiments and the 
attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the entire 
25 structure of a communication system including a video 

communication system according to one embodiment of the 
present invention; 
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Fig. 2 is a block diagram showing the structure of 
main software of a video transmitter 20 and a monitor 
60 according to one embodiment of the present 
invention; 

5 Fig. 3 is a view showing a display example of the 

monitor according to one embodiment of the present 
invention; 

Fig. 4 is a view showing a display example of the 
monitor according to one embodiment of the present 
10 invention; 

Fig. 5 is a view showing a display example of a 
window for displaying video from a video camera, 
according to one embodiment of the present invention; 

Fig. 6 is a view showing the state when display is 
15 performed by a drag-and-drop operation, according to 
one embodiment of the present invention; 

Fig. 7 is a view showing a mouse cursor of a video 
camera used in the drag- and drop operation according to 
one embodiment of the present invention; 
20 Fig. 8 is a view showing the state when a display 

area by the drag-and-drop operation is changed, 
according to one embodiment of the present invention; 

Fig. 9 is a view showing a camera icon 
representing that taken video is being displayed, 
25 according to one embodiment of the present invention; 

Fig. 10 is a view showing the state of an 
operation to stop the display by the drag-and-drop 




- 6 - 



operation according to one embodiment of the present 
invention; 

Fig. 11 is a view showing a bit map of a camera 
symbol according to one embodiment of the present 
5 invention; 

Fig. 12 is a flow chart showing an operation 
performed by a user when preset information is to be 
stored, in a certain monitor, according to one 
embodiment of the present invention; 
10 Fig. 13 is a flow chart showing an operation 

performed by the user when the preset information is 
transmitted to a video camera, in a certain monitor, 
according to one embodiment of the present invention; 
Fig. 14 is a flow chart showing an operation 
15 performed by the user when the preset information is to 
be deleted, in a certain monitor, according to one 
embodiment of the present invention; and 

Fig. 15 is a flow chart showing an operation 
performed by the user when the preset information is 
20 transmitted to the video camera, in a certain monitor, 
according to one embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, embodiments of a video communication 
25 system according to the present invention will be 
described in detail with reference to the attached 
drawings . 
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Fig. 1 is a block diagram showing the entire 
structure of a communication system including a video 
communication system according to one embodiment of the 
present invention. 
5 In Fig. 1, numeral 10 denotes a video camera which 

generates video (or an image signal) on the basis of a 
taken image. Numeral 20 denotes a video transmitter 
such as a work station ( WS ) , a personal computer ( PC ) 
or the like which transmits the image signal from the 

10 video camera 10 to a monitor 60 and receives a control 
signal from the monitor 60 to control the video camera 
10. Numeral 60 denotes the monitor such as the WS, the 
PC or the like which receives the image signal from the 
video transmitter 20 and transmits the control signal 

15 to the video transmitter 20 to control the video camera 
10. 

The plural video transmitters 20 and the plural 
monitors 60 can communicate with others through a 
network 100. Preferably, the video transmitter 20 
20 analog- to-digital (A/D) converts the image signal from 
the video camera 10 into digital image data, compresses 
the obtained digital image data, and transmits the 
compressed data to the monitor 60 through the network 
100. 

25 Numeral 12 denotes a camera control circuit which 

controls panning, tilting, zooming, focusing and 
irising operations in accordance with the control 
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signal (i.e., a control code) from the video 
transmitter 20. The control signal is input from an 
input/output interface (I/O) 32 of the video 
transmitter 20 to the camera control circuit 12 on the 
5 basis of standards such as an RS-232C USB (Recommended 
Standard 232C for Universal Serial Bus), an IEEE 
(Institute of Electrical and Electronic Engineers) 1394 
standard, and the like. 

If the video camera 10 does not perform the 

10 panning, tilting, zooming, focusing and irising 

operations, the camera control circuit 12 is not always 
necessary. However, it is preferable to control ON/OFF 
of the power supply of the video camera 10. 
(Video Transmitter 20) 

15 Next, the structure of the video transmitter 20 

will be explained. Numeral 24 denotes a main memory, 
and numeral 26 denotes a storage unit such as a hard 
disk or the like. Numeral 28 denotes a mouse which 
acts as a pointing device. However, other devices such 

20 as a touch panel on a bit map display 35 and the like 
may be also used. Numeral 30 denotes a keyboard which 
acts as input means. Numeral 25 denotes an external 
memory from which a storage medium such as a floppy 
disk, a CD-ROM, an MO or the like is detachable. 

25 Numeral 32 denotes the I/O which is connected to the 
camera control circuit 12 to transmit and receive the 
control signal of the video camera 10. Numeral 34 




denotes a video capture board which captures a video 
output signal VD of the video camera 10. The video 
output signal VD may be an analog signal such as a 
general NTSC (National Television System committee) 
5 signal or a digital signal. If the signal VD is the 
analog signal, it is necessary for the video capture 
board 34 to have an A/D conversion function. Numeral 
36 denotes a video board which obtains the video 
captured by the video capture board 34 through a system 

10 bus 39 and displays the obtained video at an arbitrary 
location on the bit map display 35. Numeral 38 denotes 
a network interface (I/F) which communicates with the 
monitor 60 through the network 100. The above units 
are connected to others through the system bus 39, and 

15 a CPU 22 controls the video transmitter 20 as a whole 

and the display of the bit map display 35 in accordance 
with software stored in the storage medium or the 
storage unit 26 or software obtained through the 
network 100. 

20 If the video capture board 34 does not have a data 

compression function, it is possible to provide 
software for realizing such the function, whereby the 
CPU 22 can perform data compression processing. 

By such the video transmitter 20 as structured 

25 above, the image data taken by the video camera 10 is 
transmitted to the monitor 60 at a remote location 
through the network 100, and the video camera 10 is 
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controlled according "to "the control code received from 
the monitor 60. It should be noted that there are the 
plural video transmitters 20 and the plural monitors 
60, and the video of the desired video transmitter can 
5 be received from any of the monitors. 
(Monitor 60) 

Next, the structure of the monitor 60 will be 
explained. It should be noted that, in the monitor 60, 
explanation of the devices or the units same as those 

10 in the video transmitter 20 will be omitted. A network 
I/F 138 receives the compressed image data from the 
video transmitter 20. A CPU 122 decompresses the 
received data (i.e., encoded data) by using a video 
compression decoder 33, and controls a video board 136 

15 on the basis of the decompressed image data to cause a 
bit map display 135 to display the image taken by the 
video camera 10 and the state of the video camera 10. 
Further, the CPU 122 transmits the control code to the 
video transmitter 20 for controlling the video camera 

20 10, in accordance with data input by the user of the 
monitor 60 with use of a keyboard 130 or a mouse 128. 

Next, the software of the video transmitter 20 and 
the monitor 60 according to the present embodiment will 
be explained. It should be noted that the software 

25 explained hereinafter is executed by the hardware of 
the video transmitter 20 or the monitor 60. 

Fig. 2 is a block diagram showing the structure of 
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the main software of the video transmitter 20 and the 
monitor 60 according to one embodiment of the present 
invention. 

First , the software to be executed by the monitor 
5 60 will be explained. Numeral 411 denotes camera 

control client software which is to remote control the 
video camera 10 connected to the video transmitter 20. 
Numeral 412 denotes video reception software which is 
to decompress the compressed image data transmitted 

10 from the video transmitter 20 in the form of packet and 
display the decompressed image data. Further, the 
video reception software 412 is to manage image data 
received from all the video transmitters 20 (i.e., the 
video cameras 10) connected to the network 100. By the 

15 video reception software 412, a camera ID of each video 
camera, a host computer ID of the video transmitter 20 
to which the video camera concerned is connected, the 
information concerning the camera operation states such 
as the panning, tilting, zooming, focusing and irising 

20 operations, the information concerning whether or not 
the video camera concerned is controllable, the state 
information concerning which video camera is currently 
controlled, and the state information concerning which 
video camera is currently displayed are stored into the 

25 monitor 60. Also the camera control client software 
411 and map management software 413 share such the 
information, whereby the information is utilized to 
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camera symbol change or the like. Numeral 413 denotes 
the map management software which uses a GUI (graphical 
user interface) function. The GUI function is to 
graphically display the location, the panning state and 
5 the tilting state of the video camera 10 and control 
the operation of the camera 10, by a map, the camera 
symbol and later-described scope display of Fig. 6. 
The above software is prestored into the storage unit 
of the monitor 60. 

10 Next, the software to be executed by the video 

transmitter 20 will be explained. Numeral 421 denotes 
camera control server software which is to control the 
panning, tilting, zooming, focusing and irising 
operations of the video camera 10 connected to the 

15 video transmitter 20 and also capture the image data 
output from the video camera 10 to the video 
transmitter 20. Numeral 422 denotes video transmission 
software which cooperates with the camera control 
server software 421 and is to transmit the video to the 

20 monitor 60 currently controlling the video camera 10. 
Numeral 423 denotes map server software. The above 
software are prestored into the storage unit 26 of the 
video transmitter 20. 

It is needless to say that, in addition to the 

25 above software, software for controlling two-way 

communication through the network 100, software for 
controlling the storage units 26 and 126, software for 
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controlling the external memories 25 and 125, and the 
like are prepared in the system. 
(User Interface) 

Next, the user interface in the present 
5 embodiment, i.e., a screen which is displayed on the 
bit map display 135, will be explained. To simplify 
the explanation, the user interface will be explained 
on the premise that one monitor 60 is connected to the 
video transmitter 20 through the network. 

10 Figs. 3 and 4 are views showing a display example 

of the monitor according to one embodiment of the 
present invention. Concretely, Figs. 3 and 4 show one 
example of the screen displayed on the bit map display 
135 of the monitor 60. In Fig. 3, numeral 500 denotes 

15 a map window in which the map is displayed. In the 

present embodiment, plural maps 510, 520, 530 and 540 
showing layouts of offices, establishments (or stores), 
warehouses and the like are managed within the map 
window 500. Since each map is added with a map tab, if 

20 the map tab is clicked by the mouse 128, the map added 
with the clicked tab is displayed up-front (as a map 
display area 502). At this time, the camera symbols 
are displayed on the up- front map. 

Fig. 3 shows the state that the map 520 is 

25 selected from among the maps 510 to 540 and displayed 
on the map display area 502. On the map 520, video 
camera symbols (or video camera icons) 521, 522, 523 
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and 524 are displayed as icons. At "this "time, if the 
map tab of the map 530 is clicked, the map 530 is 
displayed as shown in Fig. 4. 

In Fig. 4, the map 530 is displayed on the map 
5 display area 502, and video camera symbols (or video 

camera icons) 531 and 532 are displayed on the map 530. 

When the camera symbol is synthetically displayed 
on the map, if preset information for the camera symbol 
is stored into the storage unit of the monitor 60, a 
10 preset symbol is simultaneously displayed. 

Preset symbols 531-1 and 531-2 shown in Fig. 4 are 
the preset symbols of the camera symbol 531 and 
respectively represent a door and a stage. In the 
present embodiment, the preset symbol is represented by 
15 a circle bit map to which a serial number 1101 is 
annexed as shown in Fig. 11. 

Of course, the preset symbol is not limited to the 
above example but may be another preferable one such as 
a character symbol if the symbol can be corresponded to 
20 the preset information. 

In Fig. 4, reference mark 0 indicates a center 
point of the camera symbol 531, and a sector area AOB 
is formed by reference marks A, B and O as shown in 
Fig. 4. 

25 A dotted line OP indicates an initial direction of 

the camera symbol 531. A radius OA indicates left edge 
direction controllable for the camera symbol 531. A 
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radius OB indicates right edge direction controllable 
for the camera symbol 531. 

The preset symbol is synthetically displayed on an 
arbitrarily designated position when an operator sets 
5 the preset information. 

For example, the preset symbol 531-1 is positioned 
on an image side of indicating the door and the preset 
symbol 531-2 is positioned on an image side of 
indicating the stage. 
10 When the preset information corresponding to each 

preset symbol is applied to an imaging apparatus, it is 
set that video near the door and video of the stage are 
respectively displayed. 

Of course, since the preset symbol is arbitrarily 
15 positioned, the operator can put the preset symbol on a 
desired position for a use of it. 

Fig. 5 is a view showing a display example of a 
window for displaying the video (or the image) from the 
video camera, according to one embodiment of the 
20 present invention. As shown in Fig. 5, in a window 
600, the videos taken by the plural video cameras 10 
are displayed on plural video display areas 610, 612, 
614, 616, 618 and 620 respectively. In the present 
embodiment, although six areas are shown as an example, 
25 it is not limited to this example. Also, the areas may 
be displayed on the same screen as that of the window 
shown in Fig. 3 or 4. Numeral 632 denotes a trash can 
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icon which is used to delete the displayed video from 
the video display area. 

Numeral 640 denotes a video camera control panel 
which includes camera control buttons for the video 
5 camera 10. It is possible by handling these buttons to 
control the panning, tilting, zooming, focusing and 
irising operations of the video camera 10, record and 
delete the preset information, and transmit the preset 
information to the video camera. 

10 Numerals 641, 642 and 643 denote preset 

information buttons for performing operations to the 
preset information of the video camera being operated. 
An operation by each button corresponds to one preset 
information and one preset symbol . 

15 Buttons 644 and 645 are used together with the 

buttons 641 to 643. The button 644 is used to give an 
instruction of storing the preset information and the 
button 645 is used to give an instruction of deleting 
the preset information. 

20 In the present embodiment, three preset 

information can be stored into the one video camera. 
However, if means for specifying the preset information 
can be more prepared by increasing the buttons, it is 
not limited to the above case. Further, it may be 

25 structured that the map is changed every click on the 
tab and the registered preset information can be 
instructed by the buttons 641 to 643 corresponding to 
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the clicked map. According to this structure, the 
number of the preset information to be controlled can 
be increased without changing the number of buttons. 
Next, the graphical user interface (GUI) of the 
5 video communication system according to the present 

embodiment will be explained with reference to Figs. 6, 
7, 8, 9 and 10. In the present embodiment, if the 
camera icon on the map 520, 530 or the like is dragged 
and dropped (i.e., a drag-and-drop operation) onto the 

10 arbitrary video display area within the video display 
window, the motion video transmitted from the video 
camera corresponding to the dragged and dropped icon is 
displayed on the video display area onto which the 
camera icon is dropped. 

15 Fig. 6 is the view showing the state when the 

display is performed by the drag-and-drop operation, 
according to one embodiment of the present invention. 
Concretely, Fig. 6 shows the state that video camera 
icon 523 is dragged and dropped onto the video display 

20 area 614. Fig. 7 is the view showing the mouse cursor 
of the video camera used in the drag-and-drop operation 
according to one embodiment of the present invention. 
Fig. 8 is the view showing the state when the display 
area by the drag-and-drop operation is changed, 

25 according to one embodiment of the present invention. 

Fig. 9 is the view showing the camera icon representing 
that the taken video is being displayed, according to 
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one embodiment of the present invention. Fig. 10 is 
the view showing the state of the operation to stop the 
display by the drag-and-drop operation according to one 
embodiment of the present invention. 
5 In the present embodiment, during the drag-and- 

drop operation, the shape of the mouse cursor is 
represented as a camera shown in Fig. 7, whereby the 
user can confirm that the drag-and-drop operation is 
being performed. At this time, on the basis of the 

10 location information of the dragged camera, the map 

management software 413 searches for the ID number of 
the camera concerned, and notifies the video reception 
software 412 of the ID of the dragged and dropped 
camera. On the basis of the notified ID, the video 

15 reception software 412 searches for the panning and 

tilting of the camera, the camera name and the name of 
the host computer to which the camera is connected, and 
notifies the camera control client software 411 and the 
map management software 413 of such information. 

20 The camera control client software 411 

communicates with the camera control server software 
421 of the video transmitter 20 to which the video 
camera 10 is connected, through the network 100 in 
accordance with the notified information. Hereafter, 

25 the operation of the video camera 10 connected to the 
video transmitter 20 is controlled between the camera 
control client software 411 of the monitor 60 and the 
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camera control server software 421 of the video 
transmitter 20 connected. The information concerning 
the panning operation, the tilting operation and the 
like of the camera is notified from the camera control 
5 client software 411 to the video reception software 412 
for a predetermined time. 

The video reception software 412 notifies 
information of the camera (panning, tilting, imaging or 
the like) to the map management software 413 for a 

10 predetermined time. The map management software 413 
changes the displaying state of the camera icon 
(panning and tilting) corresponding to the camera on 
the map based on the notified information, displays the 
preset symbol and deletes the preset symbol. 

15 The camera control client software 411 also 

manages the preset information. 

Storage of the preset information, storage of a 
position of the preset symbol, transmission of the 
preset information to the camera and deletion of the 

20 preset information will be explained with reference to 
Figs. 12, 13, 14 and 15. 

Fig. 12 is a flow chart showing a storage 
procedure of the preset information. The preset 
information is recorded as follows. That is, 

25 initially, the preset information storage button 644 is 
clicked by the mouse (step S1204) after operating the 
imaging apparatus to have panning, tilting and zooming 
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values desired to be stored as the preset information 
(step S1202). Next, a desired position of displaying 
the preset symbol is designated by clicking that 
position on the map by the mouse (step S1205). Then, 
5 an arbitrary preset information button among the 
buttons 641 to 643 is clicked by the mouse ( step 
S1206). As above, the preset information and the 
position of the preset symbol relative to the preset 
information buttons are stored (step S1208). 

10 The camera control client software 411 sends a 

notification to the map management software 413 when 
the preset information is stored. On the basis of this 
notified instruction, the map management software 
synthetically displays the preset symbol corresponding 

15 to the preset information button onto the stored 
position on the map. 

As referred to Fig. 13, the preset information can 
be transmitted to the camera as follows. 

When the preset information buttons 641 to 643 are 

20 clicked by the mouse (step S1302) in a state of being 
selected the camera icon corresponding to the imaging 
apparatus which is displaying video upon being 
performed a displaying operation, the correspondingly 
stored preset information is sent from the camera 

25 control client software 411 to the camera control 
server software 421 (step S1304). 

In this state, the same effect can be obtained by 
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an operation of directly clicking the camera symbol by 
the mouse without clicking the preset information 
buttons 641 to 643. Hereinafter, a transmission 
procedure for transmitting the preset information to 
5 the camera by clicking the preset symbol by the mouse 
will be explained with reference to Fig. 15. 

When the map is clicked by the mouse (step S1502), 
the map management software 413 checks whether or not 
there is the preset symbol onto a clicked position 

10 (step S1504). If there is, it is checked whether or 

not the imaging apparatus relative to the preset symbol 
is imaging the video (step S1506). When the imaging 
apparatus is imaging the video, an instruction of 
transmitting the preset information corresponding to 

15 the preset symbol is notified to the camera control 

client software 412. Then, the camera control client 
software 412 sends the preset information to the camera 
control server software (step S1508). 

In the present embodiment, the number of the 

20 preset symbol is to be corresponded to the serial 

number of the preset information buttons on the camera 
control panel . 

Fig. 14 is a flow chart showing a deletion 
procedure of the preset information. The preset 

25 information deletion button 645 is clicked by the mouse 
(step S1402), and the preset information button to be 
desired to delete the preset information is clicked by 
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the mouse (step S1404). Then, the preset information 
relative to the clicked preset information button can 
be deleted (step S1406). 

When the preset information is deleted, the camera 
5 control client software 411 sends the notification to 
the map management software 413. On the basis of the 
notified instruction, the map management software 
deletes the preset symbol corresponding to the preset 
information deleted from the map. 

10 In case of setting the preset information, an 

imaging video of whole area which can be taken by the 
video camera 10 (a sector area AOB in Fig. 4) is to be 
displayed on the bit map display 135. The operator 
sets the preset information with use of the mouse 128 

15 while observing the video. 

Concretely, the operator instructs a desired 
position on the display of the above whole area. 
Accordingly, information of the desired position is 
sent to the video camera 10 through the network 100 and 

20 the video transmitter. 

In accordance with this position information, the 
video camera performs the panning and the tilting 
operations and takes video including the instructed 
position to send it back to the monitor 60. 

25 The operator instructs direction (panning and 

tilting) and zooming of the camera through operations 
at the video camera control panel shown in Fig. 5, 
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while confirming -the bit map display 135 on which the 
video is displayed. When the video camera maintains a 
state desired by the operator upon confirming the taken 
video which is continuously changed according to the 
5 instruction, the preset information (panning, tilting, 
zooming and irising values at that time) is set by the 
operator to click the above preset information storage 
button by the mouse. 

As above, the operator can intuitively grasp the 

10 preset positional relationship of the imaging object by 
displaying the preset symbol on an arbitrary position 
desired by the operator. 

Since the imaging apparatus can be controlled on 
the basis of the corresponding preset information by 

15 clicking the preset symbol by the mouse, not only it 
becomes possible to easily control the imaging 
apparatus using only the map, but also it becomes 
possible to quickly turn a face of the imaging 
apparatus to the direction of the imaging object. 

20 The operator can give a title from the keyboard 

130 according to the preset information which was set 
as above. This title is stored into the storage unit 
126 of the monitor 60 or the external memory 125, 
corresponding to the preset information. 

25 The title corresponding to the preset information 

(position) is displayed when an instruction image 
(arrow mark) of the mouse 128 is moved onto the preset 
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symbol. When the instruction image (arrow mark) of the 
mouse 128 is moved onto the camera symbol 531 shown in 
Fig. 4, a preset display button which was set to the 
video camera of the symbol 531 may be displayed. In a 
5 case where the map is not complex, the title may always 
be displayed. The above process is also executed under 
the control of the camera control client software 411 
after the process in the step S1206 shown in Fig. 12. 
In this way, by giving the title corresponding to the 
10 preset information (position), it becomes possible to 
understand why the operator sets the preset 
information, in a few days. 

According to the above display of the preset 
symbol, the operator can grasp the positional 
15 relationship of the imaging object which was preset. 

The map management software 413 updates the map 
stored in the video board 136, thereby changing the 
direction of the camera icon according to the direction 
of the actual video camera 10, drawing a scope 910 
20 (Fig. 9) representing that the video (or the image) 
taken by the video camera 10 concerned is being 
displayed, and drawing a control pointer 920 (Fig. 9) 
to control the panning, tilting and zooming operations 
of the camera, the preset symbols, for example, 531-1, 
25 531-2 and the like within the scope 910. 

Further, the information concerning the panning 
operation, the tilting operation and the like of the 
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camera is notified from the video reception software 
412 to the map management software 413 for a 
predetermined time. Thus, if the panning state, the 
tilting state, the zooming state and the like of the 

5 camera, and the presence or absence state of the preset 
information are changed on the camera control panel 
640, such the changes are reflected on the displaying 
states of the camera icons 521, 522, 523, 524 and the 
like, and the preset symbols 531-1, 531-2 and the like. 

10 The actual image data is transmitted from the 

video transmitter 20 in accordance with the request 
from the video reception software 412 of the monitor 
60. The video reception software 412 transmits a 
command to the video transmission software 422 of the 

15 video transmitter 20 to which the video camera 10 

concerned is connected, through the network 100. This 
command is to request data transmission of one frame. 
The video transmission software 422 receives the 
command, divides the captured latest frame data into 

20 packets, and then transmits these packets to the video 
reception software 412. The video reception software 
412 restructures the image frame from the received 
packets, displays the restructured image frame on the 
video display area, and again transmits the video 

25 transmission request command. By repeating such 
operations at high speed, the video at the remote 
location is transmitted and displayed through the 
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network 100. Thus, the video taken by the video camera 
10 remotely located is displayed on the bit map display 
135 of the monitor 60. 

When the videos taken by the plural video cameras 
5 10 are displayed on the screens, the video transmission 
request command is issued, the captured video is 
compressed, the frame is divided into the packets, the 
divided packets are transmitted to the network, the 
packets are received, the frame is restructured, the 
10 compressed data is decompressed, and the decompressed 
video data is displayed in turn and repeatedly, for 
each of the video transmission software of the video 
transmitter 20 to which each camera is connected. 

The video taken by the video camera can be shifted 
15 by dragging and dropping the displayed video to the 

desired video display area as shown in Fig. 8. Fig. 8 
shows the state that the video taken by the video 
camera icon 523 displayed on the video display area 614 
is shifted to the video display area 612. At this 
20 time, the video reception software 412 clears the area 
614, and changes internal parameters such that the area 
612 (i.e., the drag-and-drop destination) acts as the 
video display area of the video of the camera 10. 
Hereafter, the video taken by the video camera 10 
25 concerned is displayed on the drag-and-drop 

destination. It should be noted that the logical 
network is not disconnected even by such the operation. 
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Namely, as described later, the once- connected 
communication network is not disconnected until the 
video display area displaying the video is dragged and 
dropped into the trash can icon. 
5 The display of the video taken by the video camera 

10 is stopped as shown in Fig. 10. Namely, the video 
display area on which the video intended to be deleted 
is being displayed is dragged and dropped into the 
trash can icon 632 within the video display window. 
10 Fig. 10 shows the state after the display of the video 
of the video camera icon 523 on the video display area 
614 is stopped. At this time, the video reception 
software 412 clears the area 614 to stop issuing the 
video transmission request command to the software 412 
15 of the video transmitter 20 connected till then. 

Further, the video reception software 412 notifies the 
camera control client software 411 and the map 
management software 413 of the fact that the display 
was stopped. 

20 The camera control client software 411 receives 

such the notification, disconnects the network to the 
video transmitter 20 connected, and clears the 
corresponding video display area. Further, the map 
management software 413 eliminates the scope display 

25 from the icon 523 of the video camera concerned, and 
updates the map. 

As other embodiments, the present invention is 
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applicable to a system composed of plural equipments 
(e.g., a host computer, an interface equipment, a 
reader, a printer and the like) or to an apparatus 
including a single equipment (e.g., a copying machine, 
5 a facsimile machine or the like). 

It is needless to say that the object of the 
present invention can be achieved in a case where a 
storage medium storing the program codes of a software 
for realizing the functions of the above-described 
10 embodiments is supplied to a system or an apparatus and 
then a computer (or CPU or MPU) in the system or the 
apparatus reads and executes the program codes stored 
in the memory medium. 

In this case, the program codes themselves read 
15 from the storage medium realize the functions of the 
embodiments, and the storage medium storing such the 
program codes constitute the present invention. 

The storage medium for supplying the program codes 
can be, for example, a floppy disk, a hard disk, an 
20 optical disk, a magnetooptical disk, a CD-ROM, a CD-R, 
a magnetic tape, a non-volatile memory card, a ROM, or 
the like. 

It is needless to say that the present invention 
also includes not only the case where the functions of 
25 the embodiments are realized by the execution of the 
program codes read by the computer, but also a case 
where an OS (operating system) or the like functioning 
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on the computer executes all the process or a part 
thereof according to the instructions of the program 
codes, thereby realizing the functions of the 
embodiments . 

Further, it is needless to say that the present 
invention further includes a case where the program 
codes read from the storage medium are once stored in a 
memory provided in a function expansion board inserted 
in the computer or a function expansion unit connected 
to the computer, and a CPU or the like provided in the 
function expansion board or the function expansion unit 
executes all the process or a part thereof according to 
the instructions of such program codes, thereby 
realizing the functions of the embodiments. 

According to the present invention, the state of 
the imaging apparatus such as the direction of the 
imaging apparatus and the like according to the stored 
control information can be easily grasped. Also, the 
relationship among the plural control information can 
be easily grasped. 

Image data which is changing is to be displayed on 
the display device by controlling the imaging 
apparatus. The storage means stores as the control 
information the state of the imaging apparatus when an 
instruction was given by an instruction device. 
Accordingly, it becomes possible to store the control 
information after confirming that how the video is 
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taken by the imaging apparatus. 

It becomes possible to easily speculate that the 
control information was what kind of information and to 
provide the control information with a state of not 
confusing a user visually. Further, the control 
information can be easily deleted. 

In a case where a position of the preset symbol is 
fixed and the map is not very precise, there sometimes 
occurs such the situation that an object image does not 
exist in the direction of the camera symbol. However, 
since the preset symbol can be put on an arbitrary 
position, positioning between the preset symbol and the 
object image can be performed without reforming the map 
precisely. 

Further, the imaging apparatus can be easily and 
intuitively controlled without redundancy by providing 
an operation means for the preset symbol on the map. 
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WHAT IS CLAIMED IS: 

1 . A communication apparatus which receives image 
data taken by an imaging apparatus connected through a 
network, comprising: 

storage means for storing control information to 
control said imaging apparatus; and 

output means for outputting to a display unit a 
synthetic image which is obtained by synthesizing a 
symbol representing a state of said imaging apparatus 
to image information indicating a setting location of 
said imaging apparatus in accordance with the control 
information stored in said storage means. 

2. An apparatus according to Claim 1, wherein 
there are the plural control information, and the 
plural symbols representing the respective states of 
said imaging apparatus corresponding to the plural 
control information are synthesized to the image 
information. 

3. An apparatus according to Claim 1, wherein the 
symbol corresponding to said imaging apparatus is 
displayed on the image information, and a control 
signal for controlling said imaging apparatus is output 
by causing an instruction device to instruct the symbol 
corresponding to said imaging apparatus. 
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4. An apparatus according to Claim 1, wherein the 
control information stored in said storage means is 
transmitted to said imaging apparatus by causing an 
instruction device to instruct information 
corresponding to the symbol. 

5. An apparatus according to Claim 1, wherein the 
image data changed by controlling said imaging 
apparatus is displayed on said display unit, and said 
storage means stores as the control information the 
state of said imaging apparatus when an instruction was 
given by an instruction device. 

6. An apparatus according to Claim 1, wherein the 
control information includes at least one of panning, 
tilting, zooming and irising control information for 
said imaging apparatus. 

7. An apparatus according to Claim 1, wherein 
said storage means stores a title corresponding to the 
control information. 

8. An apparatus according to Claim 7, wherein 
said output means also outputs the title to said 
display unit. 

9. An apparatus according to Claim 8, wherein the 
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title is output according as an instruction image of an 
instruction device is moved onto the symbol. 

10. An apparatus according to Claim 1, wherein 
the control information is deleted according to a 
deletion instruction from an instruction device. 

11. An apparatus according to Claim 5, wherein 
there are said plural imaging apparatuses, and the 
control information can be instructed to each of said 
imaging apparatuses. 

12. An apparatus according to Claim 1, wherein 
the state of said imaging apparatus is the direction of 
said imaging apparatus. 

13. An apparatus according to Claim 2, wherein 
the state of said imaging apparatus is the direction of 
said imaging apparatus. 

14. An apparatus according to Claim 5, wherein 
the state of said imaging apparatus is the direction of 
said imaging apparatus. 

15. An apparatus according to Claim 1, wherein a 
synthesizing position can be arbitrarily designated 
when the symbol is synthesized to the image 
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information . 

16. An apparatus according to Claim 1, wherein 
said storage means stores a synthesizing position 
corresponding to the control information. 

17. A control method of a communication apparatus 
which receives image data taken by an imaging apparatus 
connected through a network, comprising the steps of: 

storing control information to control the imaging 
apparatus ; and 

outputting to a display unit a synthetic image 
which is obtained by synthesizing a symbol representing 
an imaging state of the imaging apparatus to image 
information indicating a setting location of the 
imaging apparatus in accordance with the stored control 
information . 

18. A storage medium which stores a program to be 
executed by a computer for controlling an imaging 
apparatus in a communication apparatus which receives 
image data taken by the imaging apparatus connected 
through a network, said program comprising: 

a code of storing control information to control 
the imaging apparatus; and 

a code of outputting to a display unit a synthetic 
image which is obtained by synthesizing a symbol 
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representing an imaging state of the imaging apparatus 
to image information indicating a setting location of 
the imaging apparatus in accordance with the stored 
control information. 
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ABSTRACT OF THE DISCLOSURE 

A communication apparatus which receives image 
data taken by an imaging apparatus connected through a 
network, comprises a storage means for storing control 
5 information to control the imaging apparatus, and an 
output means for outputting to a display unit a 
synthetic image which is obtained by synthesizing a 
symbol representing a state of the imaging apparatus to 
image information indicating a setting location of the 
10 imaging apparatus in accordance with the control 

information stored in the storage means- Accordingly, 
a stored state of the imaging apparatus can be easily 
grasped- 
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